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Listing of Claims: 

1 . (Currently Amended) The method of locating objects positioned in front of a 
computer controlled display area, the method comprising: 

deriving an intensity function by displaying and capturing first calibration objects 
having different intensity values to obtain captured intensity values corresponding to 
the displayed intensity values of the calibration objects and mapping the displayed 
values to the captured values: 

deriving a coordinate location function bv capturing second calibration objects: 

displaying an image having corresponding image data in the display area; 

converting the image data into expected captured display area data using a the derived 
coordinate location function and a the derived intensity function; 

capturing the image in an image capture area to obtain captured data that includes 
captured display area data corresponding to a predetermined location of the display 
area in the capture area; 

comparing the expected captured display area data to the captured display area data; 

wh e r e in non matohing comparod imago data locations correspond to locations of th e 
ebreets locating the objects bv identifying non-matching compared data locations . 

Claim 2 (Cancelled) 

Claim 3 (Cancelled) 

4. (Currently Amended) The method described in Claim 2 I wherein displayed and 
captured intensity values are one of grayscale intensity values and color intensity 
values. 

5. (Currently Amended) The method described in Claim 3- 1 further comprising 
determining a look-up table representative of the intensity function using 
interpolation. 
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(Currently Amended) The method described in Claim £ i further comprising deriving 
the location function from coordinate mappings using a perspective transformation. 

(Original) The method described in Claim 6 further comprising displaying five or 
more gesonicalibration images and deriving the location function using a perspective 
transforation having nine associated coefficients for determining a two coordinate 
perspective transformation. 

(Original) The method described in Claim 1 further comprising comparing the 
expected captured display area data to the portion of the captured display area data 
corresponding to the predetermined location of the display area by: 

subtracting pixel values of the expected captured display area data from 
corresponding pixel values of the captured display area data to obtain difference data 
at each coordinate location of the display area; and 

for each coordinate location, comparing the difference data to a threshold noise value 
to identify the location of the objects in front of the display area. 

(Original) The method as described in Claim 8 wherein the threshold noise value 
is dependent on lighting conditions, type of image displayed, and camera quality. 

1 0. (Original) The method as described in Claim 1 wherein pixel values at non- 
matching locations of the captured display area data are set to a first intensity value 
and the remaining pixej values of the captured display area data are set to a second 
intensity value. 

11, (Currently Amended) A method-of calibrating a system including a computer 
controll e d display area and on image captur e ar e a of an imago captur e d e vic e 
comprising: The method as described in Claim 1 4 further comprising deriving a 
location function by: 

displaying a plurality of calibration images within the display area each including a 
calibration object having an associated coordinate location within the display area; 

capturing a plurality of images of the display area within the capture area each 
including one of the plurality of calibration images; 
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for each captured image, mapping the coordinate location of the calibration object in 
the display area to a coordinate location of the calibration object in the predetermined 
location of the display area in the capture area; and 

deriving the location function from the coordinate location mappings. 

12. (Original) The method described in Claim 1 1 further comprising deriving the 
location function from the mappings using a perspective transformation. 

1 3 . (Original) The method described in Claim 12 further comprising displaying five 
or more calibration images and deriving the location function using the perspective 
transformation having nine associated coefficients for determining a two coordinate 
perspective transformation. 



14. (Currently Amended) Th e method as d e scrib e d in Claim 1 1 further comprising 
d e riving the intensity function by: A method of calibrating a system including a 
computer controlled display area and an image capture area of an image capture 
device comprising: 

displaying at least two intensity calibration objects in at least one image within the 
display area each having a different associated displayed intensity value; 

capturing the at least two displayed intensity calibration objects in the at least one 
image to obtain captured intensity values cotresponding to the displayed intensity 
values; 

mapping the displayed intensity values to the captured intensity values; and 
deriving the intensity function from the intensity value mappings. 

15. (Original) The method described in Claim 14 further comprising determining a 
look-up table representative of the intensity function using interpolation. 

16. (Currently Amended) A system comprising: 
a computing system; 

a display area controlled by the computing system to display an image in the display 
area having corresponding image data; 




4 



PAGE 5/9" RCVD AT 5/24/20044:44:53 PM [Eastern Daylight Time] ' SVR:USPT0-EFXRF-1/3 * DNIS:8729314 * CSID:6508528063 * DURATION (mm-ss):0242 



MAY. 24. 2004 1:43PM 




NO. 409 1 P. 6 



US Application No. 09/775032 
an image capture device for capturing the image within a capture area to obtain 
captured data that includes captured display area data corresponding to a 
predetermined location of the display area in the capture area; 

calibration means including: 

means for deriving an intensity function bv displaying and capturing first 
calibration objects having different intensity values to obtain captured 
intensity values corresponding to the displayed inten sity values of the 
calibration objects and mapping the displayed values to the captured values: 
and 

means for deriving a coordinate location function by capturing second 
calibration objects; 

an object locator including: 

an image data converter for converting the displayed image data into expected 
captured display area data using a the derived coordinate location function and 
a the derived intensity function; 

a means for comparing pixel values of coordinate locations of the expected 
captured display area data to corresponding coordinate locations in the 
captured display area data; 

wherein non-matching compared image data corresponds to locations of non- 
displayed image objects in front of the display area. 

17. (Original) The system as described in Claim 16 wherein the coordinate mapping 
function is derived from the mappings using a perspective transformation. 

1 8. (Original) The system as described in Claim 16 wherein the display area is one of 
a projection screen and a computer monitor and the image capture device is one of a 
digital still camera, a digital video camera, an analog still camera, and an analog video 
camera. 

1 9. (Original) The system as described in Claim 16 further comprising a means for " 
predetermining the location of the display area in the capture area by deriving 
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constructive and destructive feedback data from image data Corresponding to a 
plurality of captured calibration images, 

20, (Currently Amended) An apparatus for locating an object in front of a display area in 
a user interactive, computer controlled display system including an image capture 
device having a corresponding capture area comprising; 

means for deriving an intensity function by displaying and capturing first calibration 
objects having different intensity values to obtain captured intensity values 
corresponding to the displayed intensity values of the calibration objects and mapping 
the displayed values to the captured values; and 

means for deriving a coordinate location function bv capturing second calibration 
objects: 

a means for converting image data corresponding to an image displayed in the display 
area into expected captured display area data using a the derived coordinate location 
function and a the derived intensity function; 

a means for comparing pixel values of coordinate locations of the expected captured 
display area data to corresponding coordinate locations in captured data 
corresponding to a predetermined location of the display area within the capture area; 

wherein non-matching compared image data corresponds to locations of objects in 
front of the d isplay area. 

21 . (Original) The apparatus as described in Claim 20 wherein the means for 
comparing pixel values comprising: 

a means for subtracting expected captured display area data pixel values from 
captured display area data to obtain a difference value for each pixel location of the 
displayed image; 

a means for comparing the difference value to a threshold value; 

wherein, for a given compared pixel location, if the absolute difference value is 
greater than the threshold value then an object is located in front of the given pixel 
location. 
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22. (Original) Hie apparatus as described in Claim 21 wherein the threshold value is 
dependent on lighting conditions, type of image displayed, and camera quality. 

23 . (Original) The apparatus as described in Claim 20 further comprising a means for 
predetermining the location of the display area in the capture area by deriving 
constructive and destructive feedback data from image data corresponding to a 
plurality of captured calibration images. 
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This application is now in condition for further review and such action is earnestly 
solicited. 



May 24, 2004 
Hewlett-Packard Company 
LegaJ Department IPA 
P.O. Box 272400 

Fort Collins, CO 80527-2400 
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Respectfully submitted, 




Susan E. Heminf 
Reg. No. 36,449 
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